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DETAILED ACTION 

1 . In the Remarks filed 1 1/07/05, Applicants submitted arguments for 
allowability of pending claims. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1-16 have been considered 
but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in . this Office action: 

(a) A patent may not be obtained though the invention Is not identically disclosed or described 
as set forth in section 1 02 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

4. Claim 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Jenkins (US Patent 4,725,956), in view of Strong (US Patent 5,384,892), and 
further in view of Farmakis etal, (US Patent 5,714,948). 

Regarding claim 1, Jenkins discloses a dialog processing system 
and method comprising 
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a control system that records a state of the UAV {aircraft flight data for a 
remoted piloted vehicle, Col. 2, Lines 33-40; sensors transmit state data to the 
autopilot, Fig. 1, element 15); 

a recognition unit for analog speech input data {voice recognizer, Col, 2, 
Lines 12-16 and 22-28) and 

an interpretation unit dynamically linked to the control system and linked to 
the recognition unit for interpreting the input data {recognizing voice commands 
and generating signals in accordance with the spoken commands, Col. 2, Lines 
22-28; Fig. 1, elements 15 and 21) and 

However Jenkins does not disclose but Strong suggests the interpretation 
unit utilizes UAV state data to interpret the input data to generate appropriate 
output data (Col. 2, Lines 58-68; Col. 5, Lines 18-25; active speech rules depend 
on detected events, Col. 7, Lines 32-44). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the teachings of Jenkins by having an 
interpretation unit utilize UAV state data to interpret the input data to generate 
appropriate output data, as suggested by Strong, in order to for the response to 
be in accordance with a current operating context. 

Moreover, the combined teachings of Jenkins and Strong do not explicitly 
disclose but Farmakis et al. suggest a recognition unit for recognizing text {text is 
generated and displayed, and incoming information is identified and forwarded to 
appropriate computer. Col. 13, Lines 49-62); and a response unit linked to the 
control system and linked to the interpretation unit for producing text or audible 
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analog speech output data {transmitted information may be text or synthesized 
voice, Col. 13, Lines 33-39; generated text, Col. 13, Lines 49-50). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Jenkins and 
Strong with a recognition unit for recognizing text and a response unit for 
producing text and audible analog speech data as suggested by Farmakis et al, 
in order to allow the control system to interact with the user in multiple ways, 
according to the situation. Enabling the recognition of text, and the production of 
text and speech allows for a versatile system that can be operated by a 
handicapped person (mute or hearing-impaired). 

5. Claim 2 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Jenkins (US Patent 4,725,956), in view of Strong (US Patent 5,384,892), further 
in view of Farmakis et al. (US Patent 5,714,948), as applied to claim 1 above, 
and further in view of Damiba (US 2002/0169613). 

Regarding claim 2, the combined teachings of Jenkins, Strong, and 
Farmakis et al. do not explicitly disclose the interpretation unit utilizes natural 
language processing. 

However, Damiba suggests the interpretation unit utilizes natural language 
processing ([0003], Lines 1-9; object can represent an aircraft, [0200], full 
paragraph). 
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Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Strong, and 
Farmakis et aL by having the interpretation unit utilize natural language 
processing. Natural language processing is a desirable attribute in an automatic 
speech recognition system (see Damiba, [0003]) and adds flexibility to the 
system by avoiding the need for memorized stylized commands. 



6. Claims 3-5 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Jenkins (US Patent 4,725, 956), in view of Strong (US Patent 5,384,892). 
further in view of Farmakis et aL (US Patent 5,714,948), as applied to claim 1 
above, and further in view of Schoneburg et aL (US 2002/0133347). 

7. Regarding claim 3, the combined teachings of Jenkins, Strong, and 
Farmakis et aL do not disclose but Schoneburg et aL suggest the voice 
interpretation unit comprises a dialog manager that controls which sub-dialog is 
active by transitioning from one dialog state to another {managing the context of 
the dialog, [0078], Lines 2-5; regulating the transitions of the states of the 
system, [0161], Lines 3-4). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Jenkins, 
Strong, and Farmakis et aL with a voice interpretation unit that comprises a 
dialog manager that controls which sub-dialog is active by transitioning from one 
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dialog state to another as suggested by Schoneburg et al. in order to execute a 
valid dialog between the system and the user. 

8. Regarding claims 4 and 5, the combined teachings of Jenkins, Strong, and 
Farmakis et al. do not explicitly disclose but Schoneburg et al. do disclose the 
input data is dynamically merged with UAV states selected from the group 
consisting of current states, past states and predicted states {considered rules, 
[0164], Lines 1-3; past context, [0162], Lines 14-22; current state, [0165], Lines 
5-8; eliminating extraneous possibilities, [0082], Lines 1-3) and the input data is 
dynamically merged to with past, present and predicted states of the UAV 
([0081], full paragraph; preprocessing the input, Fig. 10; considered rules, [0164], 
Lines 1-3; past context, [0162], Lines 14-22; current state, [0165], Lines 5-8; 
eliminating extraneous possibilities, [0082], Lines 1-3). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Jenkins, 
Strong, and Farmakis et al. by having the input data dynamically merged with 
UAV states selected from the group consisting of current states, past states and 
predicted states and dynamically merged with past, present and predicted states 
of the UAV, as suggested by Schoneburg et al. In order to evaluate the input data 
in the appropriate context. Using a discourse control mechanism that considers 
past and present states of the system allows the control system to provide the 
best possible responses to a particular situation, as taught by Schoneburg et al. 
([0101], full paragraph). 
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9. Claim 6 is rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Jenkins (US Patent 4,725,956), Strong (US Patent 5,384,892), further in view of 
Farmakis etal. (US Patent 5,714,948). 

Regarding claim 6, Jenkins further discloses the interpretation unit is 
limited to a predetermined air traffic control specific vocabulary {voice command 
air control system, Col. 2, Lines 22-28). 



10. Claims 7, 1 1 and 12 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Strong (US Patent 5,384,982), in view of Jenkins (US Patent 
4,725,956). 

1 1 . Regarding claim 7, Strong suggests a dialog processing method 
comprising 

detecting commands {selecting the conrect command, Col. 6, Lines 26- 

30); 

interpreting the commands in context of dynamic UAV state information 
(Col. 2, Lines 58-68; Col. 5, Lines 18-25; active speech rules depend on detected 
events. Col. 7, Lines 32-44; Col. 6, Lines 34-36); and 

producing responses in accordance with the interpretation of the detected 
commands {system responds in a predetermined way, Col. 13, Lines 29-32). 
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However, Strong does not explicitly disclose but Jenkins discloses that the 
state is a state of a UAV system {aircraft flight data, Col. 2, Lines 37-40; sensors 
transmit state data to the autopilot, Fig. 1 , element 1 5). It is common practice in 
the art to enhance a system's versatility by including a speech recognition 
interface for control of the system. 

Therefore it would have been obvious at the time of the invention to 
supplement the teachings of Strong with having the system state be a state of an 
UAV, as disclosed by Jenkins since it is common practice in the art to include a 
speech recognition interface to provide useful, alternative means for control of 
the system. 

12. Regarding claim 1 1 , Strong does not disclose but Jenkins does disclose 
the commands may initiate from the UAV {autopilot, Col. 2, Lines 34-40). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the teachings of Strong with commands 
initiated by the UAV as disclosed by Jenkins in order to allow the UAV to 
accomplish its mission without needing more real-time control from the ground or 
other vehicles. 

13. Regarding claim 12, the teachings of Strong do not explicitly disclose but 
Jenkins does disclose the commands may initiate from a source external to the 
UAV {remotely piloted vehicle, Col. 2, Lines 22-28). 
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Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the teachings of Strong to have the 
commands initiated from a source external to the UAV, as disclosed by Jenkins, 
in order to allow the remote control of the aircraft. 



14. Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Strong (US Patent 5,384,982), in view of Jenkins (US Patent 4,725,956), as 
applied to claim 7 above, and further in view of Lewis etaL (2002/0161584). 

Regarding claim 8, the combined teachings of Strong and Jenkins do not 
disclose but Lewis et aL do disclose natural language processing methods are 
used to interpret the commands {user can express commands using natural 
language, [0007]). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement combined teachings of Strong and 
Jenkins with natural language processing methods to be used in the 
interpretation of commands, as disclosed by Lewis et aL in order to allow UAV 
dialog processing system to receive spontaneous, naturally spoken commands 
from the ground station. 
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15. Claim 9 is rejected under 35 U.S.C. 103(a) as being unpatentable over by 
Strong (US Patent 5,384,982), in view of Jenkins (US Patent 4,725,956), as 
applied to claim 7 above, in view of Schoneburg et ai (US 2002/0133347). 

Regarding claim 9, the combined teachings of Strong and Jenkins do not 
explicitly disclose but Schoneburg et aL suggest the state information includes 
current states, past states and predicted states {considered rules, [0164], Lines 
1-3; past context, [0162], Lines 14-22; current state, [0165], Lines 5-8; eliminating 
extraneous possibilities, [0082], Lines 1-3). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Strong and 
Jenkins by having the UAV state information include present states, past states 
and predicted states, as suggested by Schoneburg et aL in order to evaluate the 
input data in the appropriate context. Using a discourse control mechanism that 
considers past and present states of the system allows the control system to 
provide the best possible responses to a particular situation, as taught by 
Schoneburg etal. ([0101], full paragraph). 

16. Claims 10 and 13 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Strong (US Patent 5,384,982), in view of Jenkins (US Patent 
4,725,956), as applied to claim 7 above, in view of Chapados et aL (US Patent 

6,356,869). 
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1 7. Regarding claim 1 0, the combined teachings of Strong and Jenkins do not 
explicitly disclose but Chapados et aL do disclose the interpreting step 
{conversation analysis) is executed as a finite state machine (Col, 5, Lines 57- 
59). 

Therefore, it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Strong and 
Kurami et aL by having the interpreting step executed as a finite state machine in 
order to efficiently use system states as a basis for evaluating the dialog and 
producing appropriate responses. 

18. Regarding claim 13, the combined teachings of Strong and Jenkins do not 
explicitly disclose the interpreting step uses a grammar to construct dialogs while 
the UAV is in flight. 

However, Chapados etal. suggest interpreting the step uses a grammar 
to construct dialogs real time {discourse management and natural-dialogue 
speech application, Col. 3, Lines 63-65). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Strong and 
Jenkins by having the interpreting step use a grammar to construct dialogs while 
a UAV is in flight, as suggested by Chapados et ai, in order to allow the UAV to 
have a dynamic dialog processing capability to receive spontaneous, naturally 
spoken commands and produce the appropriate responses. 
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19. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable Strong 
(US Patent 5,384,982), in view of Jenkins (US Patent 4,725,956). further in view 
of Chapados et ai (US Patent 6,356,869), as applied to claim 13 above, and 
further in view of Stammler et ai (US 6,839,670). 

Regarding claim 14, the combined teachings of Strong, Jenkins and 
Chapados etal. do not disclose the interpreting step uses a learning process to 
add unknown commands to a list of possible commands. 

However, Stammler et aL do disclose the interpreting step uses a learning 
process to add unknown commands to a list of possible commands {additional 
speech commands, Col. 4, Lines 24-29), 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Strong, 
Jenkins and Chapados et al. and use a learning process to add unknown 
commands to a list of possible commands, as taught by Stammler et aL, in order 
to allow the system to be updated according to evolving requirements. 

20. Claim 15 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Strong (US Patent 5,384,982), in view of Jenkins (US Patent 4,725,956), as 
applied to claim 7 above, and in view of Monaco et al. (US Patent 6,314,402). 



Regarding claim 15, the combined teachings of Strong and Kurami et aL 
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do not explicitly disclose but Monaco et ai do disclose the commands are broken 
down into sub-commands (Col. 19, Lines 33-37). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Strong and 
Jenkins and have the commands broken down into sub-commands, as taught by 
Monaco et at. in order for the dialog processing system to have a relevant logical 
structure. 



21. Claim 16 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Strong (US Patent 5,384,982), in view of Jenkins (US Patent 4,725,956), and 
further in view of Neumann ef a/. (US Patent 6,735,592). 

Regarding claim 16, the combined teachings of Strong and Jenkins do not 
explicitly disclose but Neumann et aL suggest the interpreting step is limited to 
dialog states common to air traffic control dialogs {air-traffic control system, Col. 
5, Line 66 - Col. 6, Line 2; dialog-states, Col. 16, Lines 30-31 and 37-39). 

Therefore it would have been obvious to one ordinarily skilled in the art at 
the time of the invention to supplement the combined teachings of Strong and 
Kurami etaL by having the interpreting step limited to dialog states common to 
air traffic control dialogs in order to avoid supplying the air traffic control dialog 
processing system with unnecessary dialog states which would slow down its 
response time. 
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Conclusion 

22. The prior art made of record and not relied upon is considered pertinent to 

applicant's disclosure. 

Miyazawa et al. (US Patent 6,070,139), disclose a system for enabling 
speech-based remote control of a model airplane. 

Doherty et al. (The WITAS Unmanned aerial Vehicle Project, Amsterdam, 
2000) disclose a dialog system for remote control of an Unmanned Aerial 
Vehicle. 

23. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Minerva Rivero whose telephone number Is 
(571 ) 272-7626. The examiner can normally be reached on Monday-Friday 9:00 
am - 6:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Wayne Young can be reached on (571 ) 272-7582. The 
fax phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). 
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